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MULT I -CHANNEL VIDEO MIXER 
FOR APPLYING VISUAL EFFECTS TO VIDEO SIGNALS 

BACKGROUND OF THE INVENTION 

[0001] 

[Technical Field of the Invention] 
The present invention relates to an apparatus for 
applying visual effects to video signals, and a program for 
visual effect application. In particular, the present 
invention pertains to a video mixer apparatus for mixing 
video signals of multiple channels while applying a visual 
effect to each of the video signals to output a mixed video 
signal . 

[0002] 
[Prior Art] 

A video mixer apparatus mixes video signals of 
multiple input channels specified by a human operator of the 
video mixer apparatus to output a mixed video signal in real 
time. Upon this operation, the video mixer apparatus selects 
input channels, sets a mixing ratio among video signals of 
the multiple input channels, and sets a visual effect to be 
applied to each of the video signals of the respective input 
channels . 

At the time of switching between input channels, the 
human operator may want to gradually change scenes from the 
preceding picture to the succeeding picture. A gradual 
change in brightness from the previous picture screen to the 
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next picture screen is called a "crossf ade . - 

Such a gradual change may be made not only at the 
time of changing screens, but also anytime the human operator 
wants to vary a visual effect with time. 

To obtain such a visual effect, the human operator 
of the video mixer apparatus manually adjusts controls or 
operators. However, since simultaneous operation of multiple 
operators is an error-prone operation, some skill is required 
to manipulate the operators. Further, since the operators 
are operated manually, it is difficult to repeat the same 
operation of the operators. 

Especially when video signals inputted in real time 
need to be outputted in real time, quick manipulation of the 
controls is required and this makes it very difficult to make 
a sudden change in visual effect. 
[0003] 

As is known in the art. for example, as disclosed in 
the following patent document 1. a video mixer apparatus 
having a function for recording and reproducing scene data is 
also known. The conventional video mixer apparatus can 
record setting states of multiple operators, which are set at 
certain timing on an operation panel in a memory device as a 
set of scene data, so that the setting states of the multiple 
operators on the operation panel at the recording time can be 
read out from the memory device at any later time to 
reproduce by a single operation the setting states of the 
multiple operators. 
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The above-mentioned scene data recording and 
reproducing function can be used to change visual effects 

automatically . 

However, since the scene data is handled as a single 
unit, the current set of operational states is changed as a 
whole promptly at the time of switching, or over a certain 

period of time . 

in other words, it does not allow for recording and 
reproducing a gradual change in visual effect in a period of 
transition during which the visual effect gradually varies. 

[0004] 

The above mentioned patent document 1 is Japanese 
patent unexamined publication No. 2002-262179. The United 
States patent application corresponding to Japanese patent 
unexamined publication No. 2002-262179 is laid open as US- 
2002-0118302-A1. 

SUMMARY OF THE INVENTION 

[0005] 

The present invention has been made to solve the 
above-mentioned problem, and it is an object thereof to 
provide a visual effect applying apparatus and a program for 
visual effect application, which make it easy to vary with 
time a visual effect applied with operators. 
[0006] 

According to the invention, there is provided an 
apparatus for inputting a video signal representative of a 
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picture from a plurality of input channels, then processing 
the video signal to apply a visual effect to the picture, and 
outputting the processed video signal to an output channel, 
in the inventive apparatus, a parameter value setting section 
includes a plurality of operators manually operable to set a 
plurality of parameter values used for applying a desired 
visual effect to the picture. A sequence control section 
sequentially feeds the parameter values in accordance with 
time progress of processing the video signal in order to vary 
with time the visual effect applied to the picture. A video 
signal processing section processes the video signal inputted 
from at least one of the input channels according to either 
of the parameter values set by the operators or the parameter 
values fed from the sequence control section. 

This inventive structure makes them possible to vary 
the visual effect applied to the input video signal according 
to the operation of the operators and to vary with time the 
visual effect in the same manner according to the output of 
the sequence control section. 

As a result, even when a video signal needs to be 
inputted in real time and a video signal applied with a 
predetermined visual effect needs to be outputted in real 
time, the visual effect can easily be varied without instant 
operation of the operators. 

The video signal may be composed of video signals of 
multiple channels like in a video mixer apparatus. In this 
case, the video signal processing section processes each of 
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the video signals of the multiple input channels according to 
some parameter values selected for each input channel fro* 
among the multiple parameter values set hy the parameter 
value setting section, or some parameter values selected for 
each input channel from among the multiple parameter values 
outputted from the sequence control section, and mixes all 
the processed video signals to output a video signal applied 
with the predetermined visual effects. 
[0007] 

Preferably in the inventive apparatus, the operators 
include a manual progression operator manually operable to 
input a desired operation amount in association with varying 
of the visual effect, so that the sequence control section 
controls the sequential feeding of the parameter values in 
response to the operation amount of the manual progression 
operator. 

Therefore, a human operator can manually operate the 
manual progression operator to arbitrarily control the 
progress of the visual effect varying with time according to 
the amount of operation of the manual progression operator. 
[0008] 

Preferably in the inventive apparatus, the operators 
include a skip operator that is operated to specify a time 
interval of updating the parameter values, so that the 
sequence control section sequentially updates the parameter 
values stepwise at the time interval specified by the sKrp 
operator . 
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Therefore, the human operator can manually operate 
the sKip operator to arbitrarily control the smoothness or 
fineness of time variations of the visual effect. 
[0009] 

Preferably in the inventive apparatus, the seguence 
control section has a memory for memorizing the parameter 
val „es set hy the operators in accordance with a desired time 
prog ress. an. reads out the parameter values in accordance 

with the time progress. 

Therefore, the human operator can operate the 
operators to vary with the time the visual effect applied 
be forehand and have the sequence control section store it. 
thereby reproducing the same visual effect . 

I£ stepwise timings stored during the time progress 
of the signal processing are few in number and the interval 
between the stepwise timings is long, for example, in the 
case where only parameter values at the first and last 
timings have been recorded, interpolation can be performed to 
output parameter values at finer timing Intervals, thereby 
applying a visual effect varying finer with time. 

tt other words, the sequence control section has 
only to interpolate and output parameter values at multiple 
timings during the time progress of the signal processing 
according to the parameter values stored at multiple timings 

of recording. 

[0010] 

Preferably in the inventive apparatus, the parameter 
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value setting section has a plurality of operators in 
correspondence to a plurality of video signals inputted from 
a plurality of input channels and sets corresponding 
parameter values for the corresponding video signals by the 
corresponding operators, the sequence control section 
sequentially feeds the corresponding parameter values for the 
corresponding video signals, and the video signal processing 
section processes the corresponding video signals according 
to the corresponding parameter values which are either set by 
the corresponding operators or fed from the sequence control 
section. Further, the sequence control section has a memory 
for memorizing the corresponding parameter values set by 
operating the corresponding operators one by one. and 
sequentially reads out the memorized parameter values in 
accordance with the time progress. 

Therefore, even if complicated operation of the 
operators is needed, like in the case where video signals of 
multiple input channels are processed and mixed to output a 
video signal applied with predetermined visual effects, the 
human operator can operate the operators a channel by channel 
basis to have the sequence control section store the 
operation results, thereby easily varying the visual effect 
with time by reproducing the recorded operation results . 
[0011] 

According to the invention, there is provided a 
program for use in an apparatus having a processor for 
inputting a video signal representative of a picture from a 
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plurality of Input channels, then processing the video signal 
to apply a visual effect to the picture, and outputtlng the 
pressed video signal to an output channel. The Inventive 
program is executable by the processor for causing the 
apparatus to perform a method comprising the steps of 
operating a plurality of operators to set a plurality of 
parameter values used for applying a desired visual effect to 
U» Picture, sequentially feeding the set parameter values in 
accordance with time progress of processing the video signal 
in order to vary with time the visual effect applied to the 
picture, and processing the video signal inputted from at 
least one of the input channels according to either of the 
parameter values set by the operators or the sequentially fed 

parameter values. 

The inventive program can run on a computer so that 
the computer executes the program to implement the visual 
effect applying apparatus. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram for explaining an 
embodiment in which the present invention is applied to a 

video mixer apparatus. 

Fig. 2 is a block diagram showing an exemplary 
har dware setup of the embodiment of the present invention. 

Fig. 3 is an illustration showing an example of an 
operation panel according to the embodiment of the present 
invention. 
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Fig. 4 is a diagram for explaining signaling paths 
according to the embodiment of the present invention. 

fig. 5 is a flowchart showing the main routine of 
exemplary operation of the embodiment of the present 
invention . 

Fig. 6 is a flowchart showing the details of picture 
quality control processing performed in step S74 of Fig. 5. 

Fig. 7 is a flowchart showing the details of 
sequence control processing performed in step S76 of Fig. 5. 

Fig. 8 is an illustration showing a specific example 

of a visual effect. 

Fig. 9 shows a specific example of sequence data for 

use in achieving the visual effect shown in Fig. 8. 

Fig. 10 shows explanatory charts showing 
interpolated sequence data. 

DETAILED DESCRIPTION OF THE INVENTION 
[0012] 

Fig. 1 is a block diagram for explaining an 
embodiment in which the present invention is applied to a 

video mixer apparatus. 

The video mixer apparatus prestores as sequence data 
setting states of parameters varied by a human operator who 
adjusts operators as time progresses. The video mixer 
apparatus can read the recorded sequence data at any later 
time to reproduce the operating procedure for control of the 
operators. This maxes it easy to control a complicated 
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visual effect varying with time. 

As shown, reference numeral 1 designates a video 
signal processing section, reference numeral 2 is a parameter 
value setting section, and reference numeral 3 is a sequence 
control section. unlixe conventional video mixer apparatuses. 
th e video mixer apparatus of the present invention has the 
sequence control section 3 to expand its visual effect 

features . 

[0013] 

The video signal processing section 1 taxes in video 
sign als of multiple input channels, and processes each of the 
video signals according to parameter values selected for each 
channel from among multiple parameter values set by the 
parameter value setting section 2. The video signal 
processing section 1 then mixes (synthesi.es, the processed 
video signals to output a composite video signal applied wrth 
a predetermined visual effect. 

Alternatively, the video signal processing section 
may perform signal processing according to multiple parameter 
values outputted from the seguence control section 3. and mrx 
th e processed video signals to output a composite video 
signal applied with a predetermined visual effect. 

The mixing process is performed hy setting signal 
paths as described later with reference to Fig. 3. 

[0014] 

The video signals of the multiple input channels are 
tho se from external video equipment such as a video camera, a 
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video tape recorder, a DVD (Digital Versatile Disk), or a 
personal computer. Further, the video picture may be motion 

picture or still picture. 

On the other hand, the video signal from an output 
channel can be fed to a television receiver, a projector, a 
personal computer, and so on. In the example of Fig. 1. the 
number of output channels is one. but another channel may 
also be provided, such as a channel for an operator's monitor, 
for outputting a mixed signal different from that of the 

output channel . 

If the apparatus has a built-in memory, the 
apparatus may read inputs from the memory and write to the 
m emory outputs after subjected to video signal processing. 

[0015] 

The parameter value setting section 2 sets multiple 
parameter values for applying a predetermined visual effect 
to each picture on the display screen according to the 
operation of multiple operators. 

As will be described later with reference to Fig. 3, 
the visual effect may be an effect relating to picture 
quality such as picture level or color, or an effect relating 
to the arrangement of an image, such as the length and width 
measurements of the screen and the arrangement of the image 

on the display screen. 

Some channel- specific operators are provided for 
respective input channels 1 to N, and according to the 
operation of the channel- specif ic operators, the parameter 



- 11 - 



setting section ^ sets parameter values for respective video 
signals of these input channels. 
[0016] 

There may also be provided a crossf ader specifying a 
synthesis ratio between two input channels or a master fader 
applying a visual effect to a synthesized video signal of the 

output channel. 

on the other hand, the sequence control section 3 
ha s a sequence data reproduction function for outputting the 
multiple parameter values at multiple timings according to 
the time progress of the signal processing to vary with time 
the visual effect applied to the picture on the display 
screen. The seguence data may be preset in a memory section, 
or calculated using a certain function. 
[0017] 

The sequence control section 3 controls the time 
pr ogress of the signal processing according to the amount of 
operation of a manual progression operator (assignable fader 

52 in Fig. 3) . 

During the time progress of the signal processing. 

m ultiple parameter values set according to predetermined 

operators are ganged together and collectively controlled. 

It allows the stored multiple parameters to be 

handled as if they were assigned to the manual progression 

operator alone, and allows the sequence data of the recorded 

parameters to be reproduced according to the operation of the 

ma nual progression operator. Namely, the operators include a 
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manual progression operator manually operable to input , 
desired operation amount in association with varying of the 
visual effect, so that the sequence control section 3 
controls the sequential feeding of the parameter values in 
.espouse to the operation amount of the manual progression 

operator. 

[0018] 

mstead of the manual operation, it is also possible 
to control the time progress automatically with a 
predetermined speed or a variation curve. 

Further, the multiple parameter values may be 
updated at certain timings to determine the roughness or 
£1 „eness of the reproduction of the sequence data with a skip 
operator (skip ratio switch 51 in Fig. 3) so that the 
interval between update timings can be controlled. This 
makes it possible to create a visual effect changing stepwise 
at intervals as well as smoothly changing visual effects. 
Namely, the operators include a skip operator that rs 
operated to specify a time interval of updating the parameter 
values, so that the sequence control section 3 sequentially 
updates the parameter values stepwise at the time interval 
specified by the skip operator. 
[00191 

The sequence control section 3 may also have a 
runction for recording sequence data to store the multiple 
parameter values in the memory section. 

in this case, for example, the multiple parameter 
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to the operation of multiple operetors are 

„c the processing. Upon 
time according to the time progress o£ the pro 
racing the seguence data, the stored multiple param t 
Jiues are read oat one hy one according to the u-^— 
o£ the signal processing. Hamely. the seguence centre 

3 has a memo, for memorising th 
se t hy the operators in accordance wrth a 

p rogress. and reads out the parameter values in accordance 

with the time progress. 

A1 ternatively. the parameters may he recorded with 
the operation of certain operators while halting the progress 

. nri cteD of recording, 
every timing srep u 

Although at least one Kind of seguence data 
be recorded, plural patterns of seguence data ma, he recorded 

variety of visual effects with split-second timing. 
[00201 

». seguence control section 3 is not limited 
recording simultaneously operating states of 

, s !t can use an overduhbing technrgue to record 
OP Tdata d ided over multiple times, to synthesis the 
sequence data diviU repro duce the 

di vided parts of recorded sequence data, and 

synthesized sequence data. 

F or example, in response to the operation of some 
operators selected for each channel from among multiple 
operators, parameter values set for a video srgnal 
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inp „t channel are recorded, and the recording process is 
repeated according to the time progress of the signal 
processing. In this case, multiple parameter values for 
app i y ing a certain visual effect to a picture on a display 
screen created by each video signal of the multiple input 
channels are recorded sequentially. 

I£ parameter values for a channel are written over 
tb. Previous parameter values of the same channel, the 
previous parameter values will he deleted. However, the 
manner of how to rewrite the previous parameters may be 
ranged to write the results of adding or subtracting the new 
parameter values to or fro, the previous parameter values, 
thereby applying a more complicated visual effect. 

[0021] 

Especially, as will be described later with 

_ Q . nrq 49 to 45 cannot apply 
reference to Fig. 3. common operators 

• , effect to video signals of multiple input 
the same visual effect to 

channels at the same tune. 

However, the sequence control section 3 can repeat 
processing for recording parameter values to be set for each 
vi deo signal of the multiple channels in response to the 
operation of the common operators 42 to « according to the 
time progress of the signal processing, so that the multiple 
parameter values for applying a predetermined visual effect 

-.a hv each video signal can be recorded by 
to a picture created by eacn vine 

overlaying one set of parameter values on another. 

Namely, the parameter value setting section 2 has a 
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plurality of operators in corresponaence to a plurality of 
vid eo signals inputtea from a plurality of input channels ana 
s ets corresponaing parameter values .or the corresponaing 
via eo signals by the corresponain g operators. The seance 
control section 3 sequentially feeas tne corresponaing 
parameter values for tne corresponaing video signals. Tne 
via eo signal processing section 1 processes the corresponaing 
vld eo signals accoralng to tne corresponaing parameter values 
wh ich are either set by tne corresponaing operators or fea 
fr om tne seguence control section 3. The seguence control 
section 3 has a memory for memorizing the corresponaing 
parameter values set hy operating the corresponaing operators 
one hy one. ana sequentially reaas out the memorized 
parameter values in accoraance with the time progress. 
[0022] 

If use of only the sequence data recorded at 
multiP le things in the time P-.ress of the signal 
processing is not enough to mafce a ti.e-var.ing visual effect 
sm ooth because the timing intervals are too long, the 
seguence control section 3 may interpolate the parameter 
value s recorded at the multiple timings in the time progress 

■ *i processing based on the recorded parameter 
of the signal processxny 

values . 

ror example, this interpolation is effective when 
only the parameter values corresponaing to operating states 
of operators only at the start ana ena points of the time 
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recorded. 

[0023] 

The video signal processing section 1. the parameter 
val ue setting section 2. ana the sequence controi section 3 
My „e housed in a video mixer apparatus, or the video signal 
processing section 1 .nay he provided as an equipment 
exponent separately from the parameter value setting sectron 
2 ana the se g uence control section 3. X personal computer 

that multiple virtual operators are 
can also be so connected that muitip 

■+ nr careen of the computer and operated 
displayed on a monitor screen or x. 

. .„*- ro i the video signal 
with a keyboard and a mouse to control tn 

processing section 1. 

To control the video signal processing section 1 on 
the personal computer, the actuation of each operator is made 
remotely controllahle . for example, with a MIDI control 
change, to transfer seguence data to the video signal 
pressing section 1 using a file format such as SMF 
(Standard MIDI File). 
[0024] 

Flg 2 is a block diagram showing an exemplary 
ha rdware setup of an embodiment of the present invention. 

in the diagram, a CPU 12 executes an operating 
program and control program with using various kinds of 

, • rh. ROM 13 and uses a RAM as a work 
setting data stored xn the ROM 13, a 

r,f the video mixer apparatus, 
area to control the operatxon of the vxa 

CPU detects events of an 
To be more specxfxc, the cfu 

a „ustment operator 17 and other operators 16 on an operator 
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v. ii to set parameter values in a video 

panel through a bus 11 to set yc 

enr 21 so as to control processing for applying 
signal processor 21 so as t-u 

a visual effect and mixing video signals. 

The writing and reading of sequence data can be 
performed by storing it in a sequence data storage device 15 
such as a flash memory, or by downloading it to the sequence 
aata storage device 15 from an external apparatus via an 
interface 18- 
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analog/digital converters 19, to 19. (digital video 
decoders) are connected to the video signal processor 21 
throogh frame buffers 20, to 20„. respectively. 

The analog/digital converters 19, to 1*. convert 
analog composite signals (video signal, color burst, 
composite synchronizing signal, to digital composite signals. 
Upon conversion, a video signal is separated into a luminance 
component (Y signal), and two chrominance components or a 
color difference signal (Cb signal, and a color difference 

signal (Cr signal) . 

Since video signals of multiple input channels 1 to 

, are not synchronized with one another, they are stored in 
the respective buffers 201 to 20N and synchronized so that 
they will be synchronously outputted to the video signal 

processor 21. 

[0026] 

The video signal processor 21 is for example a DSP 
(Digital Signal Processor). The video signal processor 21 
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selects any video signals inputted with respective parameter 

setting values and mixing signal paths set by the CPU 12. 

mlx es and outputs the selected video signals in real time. 

A video output circuit (digital video encoder) 22 

generates an analog composite signal from the Y. Cr. and Co 
signal components of the video signal outputted from the 
video signal processor 21. and outputs an analog composite 
signal to a video display apparatus to display a screen 
corresponding to the output video signal. 
[0027] 

The bus 11 has an interface (PC/10) 18 for 
connection to an external personal computer and the like. 
The external personal computer creates operators on its 
monitor screen to allow the human operator to control the 
operators through a GUI with a keyboard and a mouse, and 

1 1 -in the same manner as 

control the video signal processor 21 xn the s 

the CPU 12. 

If the ROM 13 is a flash memory, the control program 
and setting data stored in it can be rewritten in the same 
manner as in the sequence data storage device 15. A new 
control program and setting data may also be installed from 
an external storage device (such as a memory card or a CD- 
ROM, . not shown, through the interface 18. or downloaded from 
a server computer on a network through the interface 18. 

The contents of setting states of parameter values 
or sequence data may be displayed on a monitor, not shown, or 
overlaid on the same monitor screen for displaying the video 
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signal output. 

[0028] 

Fig 3 is an illustration showing an example of an 
operation panel 31 accor.ing to the en.hoai.ent of the present 
invention. 

in Fig. 3. reference numerals 32 to 35. and 40 
designate parameter operators. each set of parameter 
operators corresponding to each input channel. The parameter 
operator 32 is a positive/negative selection switch. The 
parameter operators 33 to 35 are rotary volumes, that ts. a 
trim volume 33 (common gain volume for x and C) . a hue 
control volume 34. a color gain (intensity of hue, volume 35. 

and a fader (slider) 40 for setting common gain for Y and C. 

Terence numeral 3, designates an LED (light-emitting diode, 

that lights up «hen a video signal has appeared in each input 

channel . 

[0029] 

^=»-io a 9 to 45 are common operators. 
Reference numerals 4 2 to *o 

each of which is in the form of a rotary volume. The common 

operator 42 is a vertical position volume for setting the 

vertical position of a display screen image created by an 

ln put video signal, the common operator 43 is a vertical srze 

volume for setting the vertical screen sise. the common 

operator 44 is a horizontal position volume for setting the 

horizontal position of a display screen image created hy an 

input video signal, and the common operator 45 is a 

horizontal size volume for setting the horizontal screen size 
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I. operation, the human operator specifies an input 
channel by tuning a channel seiection switch 46. ana sets 
parameters corresponding to the selectea input cnannei with 
the operation of the common operators 42 to 45. 

M the human operator seieots the "off position for 
the cnannei seiection switch 46. since it is changed to a 
preset seiect function which aiiows the human operator to 
preset the arrangement of an image, the human operator sets 
preset states with the operators 42 to 46. The common 

operators 42 to 46 may he replaoea by separate sets of 
operators, each set exclusively proviaea for respective 
adjustments to each channel. 

Reference numeral 49 designates an operator for 

the operator 4, is a main faaer in this example. Reference 
numeral 47 designates an LED (light-emitting aioae, that 
lights up when a vtaeo signal has appearea in the output 
channel. 

[0030] 

Reference numeral 38 designates a set of solo 
swltch es, each of which is provided corresponding to each 
inpu t channel. Pushing one solo switch 38 causes only a 

nHlnn to the input channel to be applied 
video signal corresponding to the inp 

-n^H +o the output channel (Main 
with a visual effect and supplied to the outp 

Out) . 

Reference numeral 39 designates a set of mute 
switches, each of which is provided corresponding to each 
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input channel. Each mute switch 3, prevents the supply of a 
video signal corresponding to each input channel to the 

output channel (Main Out). 

Reference numeral 41 designates a set of preview 
switches, each of which is provided corresponding to each 
input channel. Each preview switch 41 supplies a video 
signal corresponding to each input channel to another output 
channel (Preview Out) to output the same to the human 
operator's monitor display. For example, the preview switch 
41 is used for displaying a video signal the human operator 
intends to newly mix. m this case, the preview switch 41 

of this input channel has been reduced to zero with the 
corresponding fader 40 (to prevent the video signal from 
being outputted to the Main Out,, the video signal will he 
outputted at a reference level. 
[0031] 

A orossfader 50 synthesizes video signals of 

» r n either "A input" or "B Input" while 
channels assigned to either e »»P 

setting their mixing ratio (0 to 1). 

Reference numeral 36 designates a set of crossfader 
assign switches, each of which is provided corresponding to 
each input channel. These crossfader assign switches are 
US ed to assign the input channels to "A Input." or "B Input." 

or "Through" if any. 

Reference numeral 48 designates a crossfader curve 
switch for switching among variation curves of mixing ratios 
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f or the crossfader 50. A afferent curve is set each time 
thi s switch is pushed. Each variation curve determines a 
functional relatien between the position of the Knob of the 
crossfader 50 and the mixing ratio. 
[0032) 

Arranged in a ho* on the bottom are operators for 
implementing sequence control features. 

select switches 54 and 55 are to change the current 
sequence number (indicated on an indicator 53,. and a newly 
selected sequence numher is confirmed hy pressing an assrgn 
button 56. Reference numerals 57. 58. and 59 designate a 
record switch, a stop switch, and an automatic play switch, 
respectively- 

Reference numeral 52 designates an assignable fader. 
Sliding the Knob of the assignable fader 52 when the 
automatic play switch 5, is off causes a synchronous reading 
of multiple parameters included in sequence data. !» this 
case, if the operation panel is such that the Knobs of the 
faders 40. 49. and the crossfader 50. and the 
positive/negative selection switches 32 and the crossfaoer 
assign switches 36 are all motor-driven to operating 

.,■„„ to the read parameters, the operation 
positions corresponding to tne reao v 

panel can sift to the manual operation mode immediately upon 
completion or interruption of the time progress of the 

sequence data. 

[0033] 

Tbe rotary volume type operators 33 to 35. and 42 to 
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45 may also he motor-driven. If these operators are of the 
rotary encoder type that controls parameter values according 
to the variations of rotation angles, an LED level meter may 
oe provided around each operator's Knoh so that a value of 
tb. level meter will correspond to a read parameter value. 

*i oets reading intervals for 
A skip ratio switch 51 sets 

updating the sequence data at the time of automatic playing 
or manually advancing tne sequence data to control the 
roughness or fineness of a reproduced visual effect. The 
operator 51 may he a s*lp ratio switch for gradually changing 

its skip ratio. 

[0034] 

Fig 4 is a diagram for explaining signaling paths 
wording to the emhodiment of the present invention. 

Th e following elements represent the features of the 

i of Pia. 1 and the video 
video signal processing section 1 of Frg. 

signa l processor 21 as an eguivalent electric circuit. The 
num her of input channels is four, and with the omission of 
the preview output channel, the numher of output channels rs 

one . 

to 6 la designate picture 
Reference numerals 61i to o-u 

qua lity controls for adjusting the guality of pictures of the 
fi rst to fourth input channels. The picture guality controls 
are controlled hy the parameters set according to the 
operation of respective channel-specific operators, namely 
the positive/negative selection switches 33. the trim volumes 
33 the hue control volumes 34. and the color gain volumes 
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shown in Fig. 3. or based on the sequence data ^ out of 
the sequence data storage device 15 shown In Pig. 2 according 
to the operation of the assignable fader 52. 
[0035] 

,„ „ 4- 0 62* designate image 
Reference numerals 62 x to e>z 4 a« a 

strangement controls for ad 3 usting the arrangement of images 
of the first to fourth input channels. The image arrangement 
controls are controlled by the parameters set according to 
the operation of the operators of the vertical position 
volume 42. the vertical size volume 43. the horizontal 
position volume 44. and the horizontal size volume 45 shown 
1„ rig. 3. or eased on the seguence data read out of the 
sequence data storage device 15. 

R eference numerals 63, to 63. designate gain controls, 
which are controlled by the parameter set according to the 

rr i or based on the 
operation of the fader 40 shown xn Fxg. 3. or ba 

storaqe device ±o. 

sequence data read out of the sequence data 

R eference numerals 64, to 64. designate on/off 
oontrol switches determining if video signals passed through 

« ^ should be outputted. The on/off 

the gain controls 63! to 63 4 shouxa o 

4 n~ri hv the solo switches 38 and 
control switches are controlled by the so 

„ . _ o n -r based on the 
the mute switches 39 shown xn Fxg. 3. or ba 

flata read ou t of the sequence data storage devxce 15. 
sequence data reao. oui ^ 

[0036] 

io fi* to 65a designate switches 
Reference numerals 65j. to od 4 

a 4-~ a pross aain control 66 from the 
selecting paths assigned to a cross gaxn 

v. «i« i to 4 Each switch selects one of 
respective input channels 1 to 4 . 
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■A input." "B input.- ana "Through" for each video signal. 
Th e switches are controlled with the operation of the 
crossfader assignahle switch 36 shown in Pig. 3. or hased on 
th e sequence data read out of the sequence data storage 
device 15. 

A connection of video signal inputs via "A Input. 
•B input." and "Through" denotes that they are added and 
synthesized. 

The cross gain control 66 synthesizes two video 

• * "a input" and »B Input" by assigning them 
signals assigned to A Input 

weights varying in directions opposite to each other. The 
or oss gain control is controlled with the crossfader 5 0 shown 
i„ Pig. 3. or hased on the sequence data read out of the 
se guence data storage device 15. The variation 
eharacteristics of the cross gain control are controlled with 

. ^ 3 or based on 
the crossfader curve switch 48 shown in Pxg. 3. 

the seguence data read out of the seguence data storage 
deV ice IS. A connection between the output of the cross gain 
control and the "Through" output of each input channel 
denotes that they are added and synthesized. 

Reference numeral 67 designates a main gain control. 
wh ich is controlled with the main fader 49 shown in Fig. 3, 

a*** read out of the seguence data storage 
or the seguence data read out 

device 1 5 . 

[0037] 

Fig 5 is a flowchart showing the main routine of 
exemplary operation of the embodiment of the present 
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invention. t 

When the video mixer apparatus is powerea on. xt is 
initially in step S71, ana operating states of multiple 
operators on the operation panei 31 are aetected in step S72. 
M any operation for picture guality oontroi is aeteotea in 
step S73. the main routine goes to step S74 (Fig. 6). or if 
^ operation for seguence control is aeteotea in step S75. 

it goes to step S76 (Fig. 6) . 

Processing of video signals is controlled in step 
S77, and other processing is performed in step S78. After 
that, the main routine returns to step S72. 
[0038] 

Flg . 6 is a flowchart showing the aetails of picture 
^ ality control processing performed in step S74 of rig. 5. 
In steps 8.1 to S». parameter values are set according to 
th e operation of the operators, it is then iuagea in step 
S96 whether it is seguence aata recoraing state ana whether a 

sequence start flag is set. 

If yes, parameter values processed in steps S82, S84. 
S86, S 9 0, and S*4 are recorded in step S97 at current timing. 
If recording over sequence data of a previously recorded 

m *.r is set the data is written by overlaying it 
sequence number is set, 

, a .. f overwriting or adding), thus 
on the previous sequence data (overwrix 

performing complicated sequence control. 
[0039] 

Fig 7 is a flowchart showing the details of 
sequence control processing performed in step S76 of Fig- 5. 
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m step S101. if operation of the record switch (57 
in Fig. 3, is detected, a record start flag is set in step 



S102 



Then, if operation of the stop switch (58 in rig. 3) 
ls detected in step S103. hoth the recording and reproduction 
of sequence data are stopped in step S104. If stop of 
r ecording is required, the recording start flag is cleared. 
I* stop of reproduction is required, the parameter values are 
h6la at this time. The parameter values are updated with the 
operation of the picture quality controls shown in Fig. 6. 

In step 105. if operation of the skip ratio switch 
(51 in Fig. 3, is detected, the setting value is changed in 
step 106. The setting value is to set the number of times 
the sequence data is read or tiding intervals in the progress 
of the sequence. A nonskipping state is also selectable. 

[0040] 

Then, in step S107 . if operation of the assignable 

fader (52 in Fig. 3, is detected, the execution procedure 

g oes to step S!09 only when it is determined in step S10S 

tbat the amount of operation exceeds the skip ratio. In step 

109. the sequence data is read out after skipped to timing 

corresponding to the amount of movement of the skip ratio 

switch. The read-out parameter value is set in the video 

/->i -in Fia 2 and see Fig. 3). 
signal processor (21 in Fig. ^, 

It is judged in step S108 whether a value 
corresponding to the amount of movement from the operator's 
position at which the previous parameter value has been 
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the skio ratio value. A specific example of 
changed exceeds the skxp rati" 

■ later with reference to Figs. 8 and 9 . 
this will be described later witn j. 

• eton quo if operation of the automatic 
Then, xn step snu, u 

play switch ,59 in Fig. 3) is detected, the execution 
procedure goes to step S113 only when it is determined in 
step Sill that the ettount of operation corresponds to the 
sKlp ratio, m step 113. sequence data values are set in the 

/oi -in Flo 2 and see Fig. 4) at 
video signal processor (21 xn Fxg. . 

timings according to the time progress. 

A specific example of this will be described later 

with reference to Fig. 10. 

in step S112. instructions responsive to other 
operations are executed. For example, a sequence number of 
sequence data to be recorded or reproduced is changed or the 
previously recorded sequence data is deleted with the 
operation of the select switches 54, 55. and the assign 

button 54. 

[0041] 

Pig. 8 is an illustration showing a specific example 

of a visual effect. 

Reference numeral 121 designates a full screen on 
the monitor. The full screen on the left carries an image at 
th. start time of visual effect application, and the full 
screen on the right carries an image at the end time of the 
visual effect application. 

F „r example, the full screen on the left carries a 
screen image 122 created from a video signal of input channel 
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! in this case, yellow is emphasized with the operation of 
the hue control volume (Hue) 34 in Fig. 3. Further, the 

* 122 is set with the operation of the vertical 
screen image 122 is sex. wj-i-i 

position volume 42. the vertical size volume 43. the 
Horizontal position volume 44. ana the horizontal size volume 
45 suoh that its center is put in a position ahout one- 
barter from the top of the full screen 12! with a vertical 
size corresponding to one-half of the full screen 121. and 
ahout one-guarter from the left of the full screen 122 with a 
h orizontal width corresponding to one-half of the full screen 

121. 

On the other hand, the full screen on the right 
carries another screen image 122 created from a video signal 
of input channel 1. In this case, red is emphasized with the 
operation of the hue control volume (Hue) 34 in Fig. 3. 
Further, the screen image 122 is set with the operation of 
the vertical position volume 42 and the horizontal position 
volume 44 such that it, center is put in a position ahout 
three-guarters from the top and left of the full screen 121 
with the same vertical and horizontal widths as those of the 
left screen image. 
[0042] 

Fig . 9 shows a specific example of sequence data for 
use in achieving the visual effect shown in Fig. 8. 

in Figs. 9(a) to 9(c). "Hue" represents hue control 
parameters set with the hue control volume (Hue) 34, »Vpos« 
represents vertical position parameters set with the vertical 
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position volume «. ana "Hpos" represents horizontal position 
parameters set with the horizontal position volume 44, 
.espectiveiy. These charts are just for purposes of 

nnt Drec isely correspond to the screen 
illustration and may not precisely 

The recording of the sequence data is started 

4- ma t-T During this time progress, 
time t-1 and ended at time t-T. During 

u,,^ ar-^ recorded in memory as 
the hue control parameters Hue are record 

in aicatea with 131. through the operation or the hue control 
volume Hue 34. the vertical position parameter, Vpos are 
reo „raea in memory as inaicatea with 133a through the 
operation of the vertical position volume 42. ana the 
horizontal parameters Hpos are recoraea in memory as 

tnaicatea with 133a through the operation or the horizontal 

position volume 44. 
[0043] 

This illustrated example shows the case where these 
Kln as of parameters change at the same time step hy step at 
^tlple aiscrete timings auring the time progress. M a 

• ir-io 9(d) it contains "scenes" a to X. 
result, as shown in Fig. 9(d). i 

xn other woras. all the variations of the parameters to 
133 a are recoraea with Keeping each parameter at a constant 
value in each "scene." 

^4-= 4-vmc recorded is reproduced. 
When the sequence data thus recora 

« the automatic play switch 59 is operatea for automatic 
r eproauction. the recoraea sequence aata has simply to he 
reaa at constant speea accoraing to the time progress. *s 
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result, the Picture signals inputtea are appliea wrth a 
vlsu al effect accede, to the variations of the storea 
multiple parameters, ana then mlxea ana ontpnttea. 

Here, a assertion will he — °* - — — 
the human operator operates the assignable faaer 52 in ,r 9 . 
to reproduce the sequence data. 
[0044] 

Fig . „«, snows the position of a Knob 134 of the 

■ ble faaer 52. in which tne Xis.it of trevel of the *nob 
assignable taaer =>^» 

u . of the time progress of the 

134 corresponds to the whole span of 
recorded sequence data. It means that the leftmost 
of the *noh ,34 indicates start timing at which the vrsual 

• started and the rightmost posxtxon 

effect applicatxon xs started applicat ion 
indicates end timing at which the vxsual effect 

13 end6d * a da ta is reproduced at six steps 

Here, the sequence data xs 

„. r, in this case , the 

time perioa t»0 to T is aiviaea into five parts to 

th e operator. Knob 13< to reea the parameter values a 

riai-a at these timings tl, t2 

133a of the sequence data at 

respectively. 

HTLuit. parameter values as maicatea with 131b 
to 13 3h are reaa out. it means that the recoraea parameters 

a out at the same timings as they were 
m ay not be always reaa out at tne 
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a11 ' case where all the parameter 

The above describes the case wne 

v _ ^ « «. - — — »;;z Z « 

icings during «- -cording of - - ; reooralng 

may he chan.ed at different things. Further. 
tlm in g s .ay be sat at constant intervals. 
[0046] 

Flg . 10 shows explanatory charts showing 

interpolated sequence data. 

k description will be made of the case 

a 4- the end time of tne 
plication and parameter value sat the ^ 

visual effect application have been record 

In this case, parameter values at some midpornt in 

s s are interpolated, for example, by a linear 
the time progress are rn P ^ ^ ^ values 

- - - — °~ - — 63 
I , r P arameter values after selected to linear 
smoothly. The p illustrated 
i n terpolation are indicated in the chart In 
example, the period of visual effect aPP—on 

into ten intervals. 

T ue numher of divided intervals can also 
controlled to vary the roughness or fineness of the visual 

effect. 

The parameter values thus created may be 
automatically reproduced with the push of the automat. p.y 
witch 59 in Pig- 3. or read out by manually operating 
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co in the same manner as in 
Knob 134 of the assignable fader 52 in the 



Fig. 9. 

[0047] 



Mthough the above description with reference to 
Figs . 3 and , was made to show the specific example in which 

nu ltiple input channels are mixed and displayed. 

0se of the crossfader 50 in Fig. 3 enables a 
action to achieve such a scene change as to fade out one 

• th e other but such a scene change is 
picture while fading in the other. 

monotonous. 

if the trim volume 33 in Fig. 3 is 
In this case, if tne u" 

operated with split-second timing during the scene change 

picture after a momentary rise of brightness can be mad. 
.though it is difficult to perform these operatic ,n m «a 
tiB e if the operations are recorded as seguence data. 

sible to achieve these operations while advancing timing 

Ips at fine intervals, rather than in real time, thereby 

offering ease of operation. 



[0048] 

Xt tne time of switching between two video signals, 

„d to be moved as shown in Fig. 8. since the 
if images need to De move 

-it- the human operator has to 
crossfader 50 cannot achxeve xt, the hum 

operate other operators manually. 

However, since such operators associated wxth the 
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arra ngement of «es ere common ope—. they cannot be 

^ — ^ - — • — - an °:r 

aS sociated with the arrangement - an image was provided 
eac h channel, it would .a ^ difficult to operate two 

channel operators at the - «~ — - «~ ^ J 

control features makes it easy to achieve the 
of the sequence control tearui 

movement of images. 
[0049] 

Fir st of all. the center position of an image of 
inp ut channel ! is move, from the center to the left en. an, 

~r.r Thpn the center 
its seguence data is recorded in memory. Then. 

th e right end to the center, and its seguence aata is 

rn other words, overdubbing is done, 
recorded in memory. In other wo 

automatic reproduction of these seguence data or 
manual reproduction of them in the manner shown in 
ena bles the function to change scenes hetween the screen 
image created hy a video signal of input channel . d the 
sor een image created hy a video signal of input channel a 
uh ile gradually moving the screen images side hy side in 
horizontal direction of the full screen. 
[0050] 

It is apparent from the ahove description that the 
pre se„t invention has the advantage of making it easy to vary 
W ith time a visual effect applied with the operation of 
operators . 

Fu rther. it has a high degree of flexibility m 
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i effect with time, and can set 
varying an applicable vxsual effect w 

even a complicated visual effect. 



- 36 - 



